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A GEOMETRIC CHARACTERIZATION OF C-OPTIMAL DESIGNS 
FOR HETEROSCEDASTIC REGRESSION 

By Holger Dette 1 ' 2 and Tim Holland-Letz 

Ruhr University, Bochum 

We consider the common nonlinear regression model where the 
variance, as well as the mean, is a parametric function of the explana- 
tory variables. The c-optimal design problem is investigated in the 
case when the parameters of both the mean and the variance func- 
tion are of interest. A geometric characterization of c-optimal designs 
in this context is presented, which generalizes the classical result of 
Elfving [Ann. Math. Statist. 23 (1952) 255-262] for c-optimal de- 
signs. As in Elfving's famous characterization, c-optimal designs can 
be described as representations of boundary points of a convex set. 
However, in the case where there appear parameters of interest in 
the variance, the structure of the Elfving set is different. Roughly 
speaking, the Elfving set corresponding to a heteroscedastic regres- 
sion model is the convex hull of a set of ellipsoids induced by the 
underlying model and indexed by the design space. The c-optimal 
designs are characterized as representations of the points where the 
line in direction of the vector c intersects the boundary of the new 
Elfving set. The theory is illustrated in several examples including 
pharmacokinetic models with random effects. 

1. Introduction. Nonlinear regression models are widely used to describe 
the relation between several variables [see Seber and Wild (1989), Ratkowsky 
(1983, 1990)]. Because of the broad applicability of such models in many 
fields, the problem of constructing optimum experimental designs for these 
models has found considerable interest in the literature. Early work has been 
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done by Chernoff (1953) who introduced the concept of locally optimal de- 
signs. These designs require an initial guess of the unknown parameters of 
the model and are used as benchmarks for many commonly used designs. 
Locally optimum designs for nonlinear models have been discussed by nu- 
merous authors [see Ford, Torsney and Wu (1992), Box and Lucas (1959), 
Haines (1993), Haines (1995), Biedermann, Dette and Zhu (2006), 
Lopez-Fidalgo and Wong (2002), Dette, Melas and Pepelyshev (2004) 
among many others]. Most of the relevant literature discusses the design 
problem under the additional assumption of a constant variance, but much 
less work has been done for models with an heteroscedastic error structure. 
Wong and Cook (1993) studied G-optimal designs for models, when het- 
eroscedasticity is present in the data. A systematic approach to optimal de- 
sign problems for heteroscedastic linear models was given by 
Atkinson and Cook (1995), who derived the necessary information matrices 
in the case where the variance, as well as the mean, depend on the parame- 
ters of the model and the explanatory variables. For other work on optimal 
designs for specific regression models with heteroscedastic errors and various 
optimality criteria, we refer to King and Wong (1998), Ortiz and Rodriguez 
(1998), Fang and Wiens (2000), Brown and Wong (2000), Montepiedra and Wong 
(2001) and Atkinson (2008) among others. 

The present paper is devoted to the local c-optimality criterion which de- 
termines the design such that a linear combination of the unknown param- 
eters (specified by the vector c) has minimal variance [see, e.g., Pukelsheim 
(1981), Pazman and Pronzato (2009)]. Under the assumption of homoscedas- 
ticity, there exists a beautiful geometric characterization of locally c-optimal 
designs which is due to Elfving (1952) who considered the case of a linear 
model. Roughly speaking, the characterization of Elfving (1952) is possible 
because the Fisher information can be represented in the form 

(1.1) I(x,0)=f(x,0)f T (x,0), 

where f(x,9) denotes a vector of functions corresponding to the particular 
model under consideration and is the vector of unknown parameters. The 
c-optimal design with support points x\, . . . , x m and weights pi, ■ ■ ■ ,p m can 
be characterized as a representation of the point 

m 

(1.2) \c = J2p r e r f(xr,0), 

r=l 

where e±, . . . G {—1, 1} and A > denotes a scaling factor such that the 
point Ac is a boundary point of the Elfving set 

(1.3) Tlx = conv{ef(x,0) \ x e X,e £ {-1, 1}}. 

Here, X denotes the design space, conv(„4) is the convex hull of a set A C W. 
This result has been applied by numerous authors to derive c-optimal designs 
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in linear and nonlinear regression models [see, e.g., 
Studden (1968), Han and Chaloner (2003), Ford, Torsney and Wu (1992), 
Chernoff and Haitovsky (1990), Fan and Chaloner (2003), Dette et al. (2008) 
among many others]. For a review on Elfving's theorem, we also refer to 
Fellmann (1999) and to the recent work of Studden (2005). On the other 
hand, in the case of heteroscedasticity, where both the mean and the vari- 
ance depend on the explanatory variables and parameters of interest, the 
information matrix is usually of the form 

k 

(i.4) i(x,e) = Y / f j (x,o)ff(x,e) 

[see Atkinson and Cook (1995)] with k>2. Here, fi, - ■ ■ , fk represent certain 
features of the nonlinear regression model under consideration (see Section 2 
for more details) and a geometric characterization of the Elfving type is 
not available. It is the purpose of the present paper to fill this gap and to 
provide a useful characterization of c-optimal designs for regression models 
with Fisher information of the form (1.4). 

In Section 2, we introduce the basic notation of a heteroscedastic nonlin- 
ear regression model and demonstrate that the Fisher information matrix 
has, in fact, the form (1.4). Section 3 contains our main results. We derive 
a general equivalence theorem for locally c-optimal designs in nonlinear re- 
gression models with Fisher information matrix given by (1.4). These results 
are used to derive a geometric characterization of locally c-optimal designs 
which generalize the classical result of Elfving to regression models, where 
the mean as well as the variance depend on the explanatory variables and 
the parameters of interest. The corresponding Elfving space has the same 
dimension as a classical Elfving space but consists of the convex hull of a 
family of ellipsoids induced by the underlying model and indexed by the 
design space (see Section 3 for details). In the special case k = 1, the gen- 
eralized Elfving set reduces to the classical set considered by Elfving (1952) 
and a similar result is obtained if the variance of the regression is a function 
of the mean. Finally, in Section 4, we illustrate the geometric characteri- 
zation in several examples. In particular, we demonstrate the applicability 
of the results in the Michaelis-Menten model with exponentially decreas- 
ing variance and in a nonlinear random effect model used in toxicokinetics, 
where the Fisher information has a similar structure as in (1.4). 

2. c-optimal designs for heteroscedastic regression models. Consider the 
common nonlinear regression model where at a point x a response Y is 
observed with expectation 



(2.1) 



E[Y\x]=fi(x,9) 
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and variance 

(2.2) Yai[Y\x]=a 2 {x,9). 

Here, 9 S W denotes the vector of unknown parameters. Note that we do not 
exclude the case, where \x and <r 2 depend on different subsets of the param- 
eter vector, that is 9 = (9i,9 2 ), fJ,(x, 6) = /i(x,6>i); a 2 (x,9) = a 2 (x,9 2 ). We 
assume that n independent observations Y±, . . . ,Y n are available under ex- 
perimental conditions x±, . . . ,x n G X, where X denotes the design space. We 
define no = (n{xi,9), • • • , n{x n , 9)) T as the vector of the expected responses, 
oj = (a 2 (xi,9), . . . , a 2 (x n , 9)) T as the vector of variances and 

(2.3) S e = diag(<7 2 (zi, 9), a 2 (x n , 6)) 

as the covariance matrix of the random vector Y = (Yy, . . . , Y n ) T . Under the 
additional assumption of a normal distribution, the Fisher information of Y 
is given by the p x p matrix 

, A n r _ d $ v-i d to 1 da 2 T 2 da 2 

An approximate experimental design is a discrete probability measure with 
masses w±, . . . ,w m at points xi,...,x m £ X. These points define the dis- 
tinct experimental conditions at which observations have to be taken and 
w±,... ,w m > 0, Y^LyWj = 1 are positive weights representing the propor- 
tions of total observations taken at the corresponding points [see 
Silvey (1980), Atkinson and Donev (1992), Pukelsheim (1993), 
Randall, Donev and Atkinson (2007)]. If N observations can be taken, a 
rounding procedure is applied to obtain integers rj from the not necessar- 
ily integer valued quantities WjN (j = 1, . . . ,m) [see Pukelsheim and Rieder 
(1992)]. If the assumption of a normal distribution is made the analogue of 
the Fisher information matrix for an approximate design is the matrix 

(2.5) M(£,0)= f l(x,0)d£(x) eM. pxp , 

Jx 

where 

T(rB) 1 f d[i(x,9) \ T dfi(x,9) 

1 ' >~a 2 (x,9)\ 89 J 89 

(2.6) 

1 / 8a 2 (x,9) \ T 8a 2 (x,9) 
+ 2a 4 (x,9)\ 89 ) 89 

denotes the Fisher information at the point x [see also Atkinson and Cook 
(1995) or Atkinson (2008)]. 
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Under some additional assumptions of regularity, it can be shown that 
the asymptotic covariance matrix of the maximum likelihood estimate for 
the parameter 9 is given by 

(2-7) ^M-\U) 

[see Jennrich (1969)]. An optimal design for estimating the parameter 9 
minimizes an appropriate function of this matrix, and numerous criteria 
have been proposed for this purpose [see Silvey (1980), Pukelsheim (1993) or 
Randall, Donev and Atkinson (2007)]. In this paper, we consider the local c- 
optimality criterion, which determines the design £ such that the expression 

(2.8) c T M~{C,9)c, 

is minimal, where c £ M p is a given vector, the minimum is calculated 
among all designs for which c T 9 is estimable, that is c E Range(M(£, 9)), 
and M~(£,9) denotes a generalized inverse of the matrix M(£,0). The ex- 
pression (2.8) is approximately proportional to the variance of the maximum 
likelihood estimate for the linear combination c T 9. It is shown in Pukelsheim 
(1993) that the expression (2.8) does not depend on the specific choice of 
the generalized inverse if the vector c is estimable by the design £. Note that 
the criterion (2.8) is a local optimality criterion in the sense that it requires 
the specification of the unknown parameter 9 [see Chernoff (1953)]. Locally 
optimal designs are commonly used as benchmarks for given designs used in 
applications. Moreover, in some cases, knowledge about the parameter 9 is 
available from previous studies and locally c-optimal designs are robust with 
respect to misspecifications of 9 [see Dette et al. (2008)]. For robustifications 
of locally optimal designs, the interested reader is referred to the work of 
Chaloner and Verdinelli (1995), Dette (1995) or Muller and Pazman (1998) 
among many others. 

Note that the Fisher information (2.4) is of the form 

k 

(2.9) I(x,9) = Y,fi(*,0)fT(x,0), 

t=i 

where k = 2 and 



1 fd»(x,9)^ 

fi{x,9) 



(2.10) 



a(x,9)\ 89 
f(r 9)- 1 f da 2 (x,9) 



Because the formulation of our main results does not yield any additional 
complication in the subsequent discussion, we consider in the following mod- 
els with a Fisher information of the form (2.9). We call a design £ c minimizing 
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c T M~ (£,0)c a locally c-optimal for a model with Fisher information matrix 
of the form (2.9), where the minimum is taken over the class of all designs for 
which c T 9 is estimable. The corresponding statements for the heteroscedas- 
tic nonlinear regression models are then derived as special cases. 

3. Elfving's theorem for heteroscedastic models. The following result 
allows an easy verification of c-optimality for a given design. 

Theorem 3.1. A design £ c is locally c-optimal in a model with Fisher 
information matrix of the form (2.9) if and only if there exists a generalized 
inverse G of the matrix M(£ c , 0), such that the inequality 

(31) T ^G fe (x)f 

holds for all x G X . Moreover, there is equality in (3.1) at any support point 
of the design £ c . 

Proof. Let S denote the set of all approximative designs on X and for 
fixed 9 let 

M = {M(t,6)\££Z}cR pxp 

denote the set of all information matrices of the form (2.5), where I(x,9) = 
J2e=i fe( x : 8)ff(x, $)• M is obviously convex and the information matrix 
M(£ c , 0) of a locally c-optimal design for which the linear combination c T 9 
is estimable [i.e., c G Range(M(£, 9))] maximizes the function (c T M~c)~ 1 
in the set M C\A C , where A C = {M(^,8)) G M\c G Range(M(^, 9))}. Conse- 
quently, it follows from Theorem 7.19 in Pukelsheim (1993) that the design 
£ c is c-optimal if and only if there exists a generalized inverse, say G, of the 
matrix M(£ c , 6) such that the inequality 

tr(^Gcc T G T ) < c T M-(£ c ,9)c 

holds for all A G A4 , where there is equality for any matrix AG M which 
maximizes (c T M~c) _1 in the set A4. Note that the family J\A is the convex 
hull of the set 

( k \ 



xex 



\^h(x,9)fl(x,e) 

and therefore the assertion of Theorem 3.1 follows by a standard argument 
of optimal design theory [see, e.g., Silvey (1980)]. □ 

The following result gives the corresponding statement for the case of the 
nonlinear heteroscedastic regression model introduced in Section 2. It is a 
direct consequence of Theorem 3.1 observing that in this case we have k = 2 
and the two functions f\ and fi are given by (2.10). 
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Corollary 3.2. Under the assumption of a normally distributed error, 
a design £ c is c-optimal for the nonlinear heteroscedastic regression model 
(2.1) and (2.2) if and only if there exists a generalized inverse G of the 
matrix M(£ c ,8) such that the inequality 

(3 - 2) aHx-J)\-^ GC ) + ^T){-^^ GC ) ~ C { ^° )C 

holds for all x G X . Moreover, there is equality in (3.2) at any support point 
of the design £ c . 

In the following discussion, we will use the equivalence Theorem 3.1 to 
derive a geometric characterization of locally c-optimal designs in nonlinear 
regression models with Fisher information of the form (2.9), which gen- 
eralizes the classical result of Elfving in an interesting direction. For this 
purpose, we define a generalized Elfving set by 

{k k \ 

3=1 3=1 > 

and obtain the following result. 

Theorem 3.3. A design £ c = {xj-jp^^i is locally c-optimal in a model 
with Fisher information matrix of the form (2.9) if and only if there exist 
constants 7 > 0, en, ... , £i m , ...,£&!,..., £km satisfying 

k 

(3.4) = 1, r = l,...,m, 

i=i 

such that the point jc E W lies on the boundary of the generalized Elfving 
set TZk defined in (3.3) and has the representation 

m ( k ~\ 

(3.5) 7 c= ]T p J Y^ £ irfi{x r ,9) \ G dK k . 

r=l U=l J 

Proof. Assume that the design £ c = {x r ;p r } 7 ^ =1 minimizes c T M~(£, 6)c 
or equivalently satisfies Theorem 3.1. We define j 2 = (c T Gc)~ l ,d = jGc G 
W, then it follows from cG Range(M(£, 9)) and the representation (2.9) 
that 

m ( k \ 

7 C = M(£ c , 9)d = Y,Pr\J2 M*r, 0)fJ(Xr,9) \d 
r=l ll=l ) 

m ( k \ 
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where we have used the notation ei r = ff(x r )d(£ = 1, . . . , k; r = 1, . . . , m). 
By Theorem 3.1, there is equality in (3.1) for each support point x r , which 
implies (observing the definition of 7 and e^ r ) 

k 

J2ej r = l, r = l,...,m. 

1=1 

Consequently, the conditions (3.4) and (3.5) are satisfied and it remains to 
show that 7c E dlZ^. For this purpose, we note that we have by Cauchy's 
inequality and Theorem 3.1 

(3.6) f^{^^x,^)) 2 <^(^^)) 2 ^^<^ e I = l 
V U=l J / £=1 1=1 1=1 

for all x E X and E\, .. . satisfying (3.4). Moreover, 7c T d = 1 by the defi- 
nition of the constant 7 and the vector d. Consequently, the vector d defines 
a supporting hyperplane to the generalized Elfving set IZ^ at the point 7c, 
which implies 7c E dlZk 

In order to prove the converse, assume that 7c E dlZk and that (3.4) and 
(3.5) are satisfied. In this case, there exists a supporting hyperplane, say 
d E MP, to the generalized Elfving set TZk at the boundary point 7c, that is, 

(3.7) 

and the inequality 
(3.8) 



jc T d=l, 



holds for all x E X , £1, . .. ,£& satisfying (3.4). Defining 

d T h(x,9) 



H k j=i{d T fj{x,e)y 



we have J2e=i £ i(x) = 1 and obtain from the inequality (3. 



(3.9) 



T.id T h{x)f 



J2d T {e e (x)f e (x,9)} 



< 1 



for all x E X . On the other hand, it follows from (3.5) and (3.7) that 

m ( k \ 

l = 1 c T d = ^2p r d T < ^2e £r f £ (x r ,6) >, 

r=l U=l J 

which implies [using inequality (3.9)] for x\, . . . ,x m , 



(3.10) 



d T ^E er Mx r , 9)^=1, 



r = 1, 



, m. 
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Consequently, we obtain using the Cauchy-Schwarz inequality 

/ k \ 2 kk 

l=[Y / ^rd T Mx r ,e)\ <^ei^(d T / £ (x r ,^)) 2 <l 
\t=i ) e=i i=i 

for each r = 1, . . . , m, which gives 

(3.11) e ir = \ r d T fe(x r ,9), £ = !,.. .,k,r = l,...,m, 

for some constants Ai, . . . , A m . Now inserting (3.11) in (3.10) yields 

k 

1 = \ r ^2(d T fi(x r ,6)) 2 = X r , r = l,...,m, 

e=i 

and combining (3.11) and (3.5) gives 

m ( k ~\ 

7C = YsPr E M X r, 0)ft(*r,6) U= M(£ c , 9)d. 
r=l U=l J 

It follows from Searle (1982) that there exists a generalized inverse of the 
matrix M(£ c ,9) such that d = jGc and we have from (3.9) for all x G X 

(3.12) 1 2 Y,{c T Gf l {x)f<l. 

i=i 

By (3.7), we have 7 2 = (c^Gc)" 1 = (c T Af _1 (C c ,6')c)" 1 and the inequality 
(3.12) reduces to (3.1). Consequently, the c-optimality of the design £ c = 
{x T ;pr}™ =1 follows from Theorem 3.1. □ 

Note that in the case k = 1 the generalized Elfving set TZt defined in 
(3.3) reduces to the classical Elfving set (1.3) introduced by Elfving (1952). 
Similarly, Theorem 3.3 reduces to the classical Elfving theorem for models in 
which the Fisher information can be represented by I(x, 9) = fi(x, 9)ff(x, 9) 
[see Pukelsheim (1993), Chapter 2, or Studden (2005)]. In the following 
corollary, we specify the geometric characterization of Theorem 3.3 in the 
special case of nonlinear heteroscedastic regression models where we have 
k = 2 and the functions /i and are given by (2.10). 

Corollary 3.4. Consider the nonlinear heteroscedastic regression model 
defined by (2.1) and (2.2) with the additional assumption of a normal dis- 
tribution, and define 

1Z = conv< 



(3.13) 



ei ( dfi(x,9) y e 2 f da 2 (x,9) 

a(x : 9){ 89 ) \/2a 2 {x,9)\ 89 



x £ X,e\ + e 2 2 = 1 
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A design £ c = {x r ;p r }'!^ =1 is locally c-optimal if and only if there exist con- 
stants 7 > and en, . . . , s\ m , £21, ■ ■ ■ , £2m satisfying e^ + q^, = 1 (r = 1, . . . , m) 
such that the point 



= V ( g ir f dfi(x r ,9) \ T e 2r ( da 2 (x r ,8) \ T 

^ Pr UKM 96 ) + V2o-*(x r ,e) \ d0 ) 



is a boundary point of the set 7Z. 

Remark 3.5. Consider the case where mean and variance in the regres- 
sion model are related by a known link function, say £, that is, 

(3.14) a 2 {x,9) =e(fi(x,9)). 

Under this assumption, a straightforward calculation shows that the Elfv- 
ing set (3.13) reduces to 

f £1 ( dy(x,6) \ T gafVM)) f dfi(x,9) \ T 
C ° nV I VWD V 09 J ^2£ 2 {^{x,9)) V 50 J 

X G A,ef +£2 = 1 

_£l ^ e 2 t?(ji(x,0)) \fd f i(x,9y 

couv< === = + 



XG^,£i+£2 = lS>. 



Now, using the values 

1 u;(a) WM)) 

£l =£^== ,,. . , £ 2 = £^== ,,, F , 



for some £ G {—1, 1} it can be easily shown that 1Z\ C 71, where the set 1Z\ 
is defined by 



XG^,£E{-1,1}|, 

and corresponds to a classical Elfving set of the form (1.3). Similarly, it 
follows observing the inequality 



£1 e 2 e'(fi(x,e)) 
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whenever ef + e\ = 1, that 1Z C 7l±, which implies 1Z = Thus, for non- 
linear heteroscedastic regression models, where the conditional expectation 
and variance are related by a known link function by (3.14), the Elfving 
set 1Z reduces to an Elfving set of the form (1.3) and the classical result of 
Elfving (1952) can be used to characterize locally c-optimal designs. 

4. Examples. In this section, we will illustrate the geometric character- 
ization by two examples. In the first example, we discuss a nonlinear het- 
eroscedastic regression model. Our second example considers a population 
model and indicates that an information matrix of the form (2.9) may also 
appear in other situations. 

4.1. A heteroscedastic Michaelis-Menten model. As a first example, we 
consider a common model in enzyme kinetics with an heteroscedastic error 
structure, that is 



(4.1) Y t = + y/e-^ei, i = l,...,n, 

#2 + Xi 



where errors are independent identically and normal distributed with mean 
and variance a 2 > 0. The parameters to be estimated are 6 = (#i,#2,#3)- 
Clearly, Var(i^) = a 2 (xi,9) := e~ e ' iXi a 2 , which means that the model is het- 
eroscedastic. Some design issues for the Michaelis-Menten model have been 
discussed by Lopez-Fidalgo and Wong (2002). In the following, we illustrate 
the geometric characterization of Section 3 by constructing optimal designs 
for estimating the minimum effective dose in the model (4.1). 

For this purpose, we assume for the parameters 9 = (3, 1.7,0.1), a 2 = 1. 
A straightforward calculation shows that 

dKx,0)_f x -e lX \^ gg^ = (0,0,-^3*^ 



86 \6 2 + x' {9 2 + x) 2 ' J ' 86 
which yields 

1 fx —6\x 



(4.2) h(x,e) 



ae 



%r/2 \0 2 +x' {0 2 + X) 2 ' 



(4.3) /2 ( a>(? ) = _^_(o i0 ,-^f. 

The corresponding generalized Elfving space is as depicted in Figure 1. Sup- 
pose we are interested in estimating the minimum effective dose x m \ n , that 
is, the smallest value of x resulting in an expected value = E. The 

solution of this equation is given by 

E02 
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An optimal design for estimating the minimum effective dose minimizes the 
variance of the estimate for a; mm . Consequently, if maximum likelihood is 
used to estimate 9 and x m i n is estimated by x m \ n = E02 / (9\ — E) an optimal 
design for estimating the minimum effective dose is a locally c-optimal design 
problem for the vector 

-EOi E ^ T 
,0 



h — Ey Q\ — £J' 

which is marked as the red line in Figure 1. Let E = 1 and the maximum 
possible observation x max = 10, that is X = [0, 10]. From the figure, we obtain 
as optimal design for estimating the minimum effective dose the two point 
design 



6 



c 



1.1 10 
0.967 0.033 



The two blue points denote the points of the form 
( 44 ) gi f dy(x,9) \ T | e 2 fda 2 (x,9) 



a(x,6)\ 89 J V2a 2 (x,6)\ 09 

{x G X, e\ + e\ = 1) which are used to represent the intersection of the 
Elfving set 1Z defined by (3.13) with the line in direction of the vector c. 
The optimality of this design can be verified by Theorem 3.1. 

4.2. A random effect nonlinear regression model. An information ma- 
trix of the form (2.9) appears also in the case of a nonlinear model with 
mixed effects and homoscedastic error structure, which has been intensively 
discussed in the toxicokinetics and pharmacokinetics literature [see, e.g., 
Beatty and Pigeorsch (1997) or Retout and Mentre (2003) among others]. 
To be precise, we consider a special case of a nonlinear mixed effects model 
which appears in population toxicokinetics, that is, 

Yi = f(xi,bi) +£i, i = l,...,n, 

where the errors are independent identically and normally distributed with 
mean and variance a 2 > 0. The quantities bi,...,b n ~ J\f(9,Q) denote 
here p-dimensional independent normally distributed random variables rep- 
resenting the effect of the corresponding subject under investigation [see 
Beatty and Pigeorsch (1997), Ette et al. (1995), Cayen and Black (1993)]. 
We assume that the random variables b\, . . . , b n and the vector (ei, . . . , e n ) T 
are independent. The variance of the random variable Y{ can be approxi- 
mated by 

v m df(x h e) T „ df( Xi ,e) 2 
Var(Y;)^CT (xi,9):= ^ Q ^ + a . 
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Fig. 1. The Elfving space 1Z defined in (3.3) for a Michaelis-Menten model (4-1) with 
heteroscedastic error structure. The functions fi and f'z are given by (4-2) and (4-3), 
respectively. The blue line denotes a part of the boundary of the set 1Z. 



It now follows by similar arguments as in Retout and Mentre (2003) that 
the Fisher information matrix for the parameter 9 at the point x can be 
approximated by 

, ft)= 1 df(x,6) T df(x,6) 1 8a 2 (x,9) T da 2 (x,9) 

{X ' ' a 2 (x,9) 86 86 + 2a 4 (x,9) 86 89 ' 

which corresponds to the case (2.9) with k = 2 and 

1 8f(x,9) 1 8a 2 (x,9) 

h{x ' 6) ~ a(x,9) 86 ' MX > 0) ~ V2a 2 (x,9) 89 " 

Consider, for example, the simple first-order elimination model 

(4.5) Y = b ie - b2X + e, xeX = [0,oo), 

which is widely used in pharmacokinetics [e.g., Rowland (1993)]. For the 
parameters, we assume 

9 = (30, 1.7), n = diag(wi,£j 2 ) = diag(l,0.1) and a 2 = 0.04. 
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d1 



Fig. 2. The Elfving space 1Z defined in (3.3) for a simple population model (4-5). The 
functions f\ and fi are given by (4-6) and (4-7), respectively. The blue line denotes a part 
of the boundary of the set 1Z. 



A straightforward calculation shows that 
d/M) -( e -<h*_g lXe -<hx^ 



de 

)2 



ae 1 de 2 ~ ' del Ml ' 

which yields 



(4.6) h(x,9) = -^—{e-^-e^e-^), 

a[x, 0) 



The corresponding generalized Elfving space is as depicted in Figure 2. If 
we are interested in the optimal design for estimating the area under the 
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curve, that is, 

roc 

auc= e ie - e2X dx = ^-, 

JO V2 
we obtain a locally c-optimal design problem for the vector 

c=(i/o 2 ,-9 1 /e%f, 

which is marked as the red line in Figure 2. From this figure, we obtain as 
locally c-optimal design for the estimation of the area under the curve the 
two point design 

/0.13 2.08 \ 
4c ~ v 0.24 0.76/' 

The two blue points denote the points of the form (4.4) which are used to 
represent the intersection of the Elfving set 1Z defined by (3.13) with the 
line in direction of the vector c. The optimality of this design can also be 
verified by Theorem 3.1. 
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